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SYSTEMS, METHODS, AND APPARATUS FOR 
OTOACOUSTIC PROTECTION OF 
AUTONOMIC SYSTEMS 

This application is a continuation application of U.S. appli- 5 
cation Ser. No. 11/836,352, entitled “SYSTEMS, METH- 
ODS AND APPARATUS FOR OTOACOUSTIC PROTEC- 
TION OF AUTONOMIC SYSTEMS,” filed Aug. 9, 2007. 
The content of this application is hereby incorporated by 
reference. 

ORIGIN OF THE INVENTION 

The invention described herein was made by an employee 
of the United States Government and may be manufactured 
and used by or for the Government of the United States of 
America for governmental purposes without the payment of 
any royalties thereon or therefor. 

FIELD OF THE INVENTION 

This invention relates generally to artificial intelligence 
and, more particularly, to architecture for collective interac- 
tions between autonomous entities. 25 

BACKGROUND OF THE INVENTION 

A synthetic neural system is an information processing 
paradigm that is inspired by the way biological nervous sys- 30 
terns, such as the brain, process information. Biological sys- 
tems inspire system design in many other ways as well, for 
example reflex reaction and health signs, nature inspired sys- 
tems (NIS), hive and swarm behavior, and fire flies. These 
synthetic systems provide an autonomic computing entity 35 
that can be arranged to manage complexity, continuous self- 
adjust, adjustment to unpredictable conditions, and preven- 
tion and recovery for failures. 

One key element is the general architecture of the synthetic 
neural system. A synthetic neural system is composed of a 40 
large number of highly interconnected processing autonomic 
elements that may be analogous to neurons in a brain working 
in parallel to solve specific problems. Unlike general purpose 
brains, a synthetic neural system is typically configured for a 45 
specific application and sometimes for a limited duration. 

In one application of autonomic elements, each of a num- 
ber of spacecrafts could be a worker in an autonomous space 
mission. The space mission can be configured as an autono- 
mous nanotechnology swarm (ANTS). Each spacecraft in an 50 
ANTS has a specialized mission, much like ants in an ant 
colony have a specialized mission. Yet, a heuristic neural 
system (HNS) architecture of each worker in an ANTS pro- 
vides coordination and interaction between each HNS that 
yields performance of the aggregate of the ANTS that exceeds 55 
the performance of a group of generalist workers. 

More specifically, subset neural basis functions (SNBFs) 
within a HNS can have a hierarchical interaction among 
themselves much as the workers do in the entire ANTS col- 
lective. Hence, although many activities of the spacecraft 60 
could be controlled by individual SNBFs, a ruler SNBF could 
coordinate all of the SNBFs to assure that spacecraft objec- 
tives are met. Additionally, to have redundancy for the mis- 
sion, inactive workers and rulers can only participate if a 
member of their type is lost. 65 

In some situations, the ANTS encounters a challenging 
situation. For example, in some instances, the operation of a 
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particular autonomic spacecraft can be detrimental either to 
the autonomic spacecraft or to the mission. 

BRIEF DESCRIPTION OF THE INVENTION 

The above-mentioned shortcomings, disadvantages and 
problems may be addressed herein, which will be understood 
by reading and studying the following specification. 

In at least one embodiment of the invention, a method for 
managing a system includes receiving a potentially harmful 
signal and transmitting a neutralizing data signal to counter- 
act the potentially harmful signal. 

In other embodiments, an autonomic element includes a 
self-monitor that is operable to receive information from sen- 
sors and is operable to monitor and analyze the sensor infor- 
mation and access a knowledge repository, a self-adjuster 
operably coupled to the self-monitor in a self-control loop, 
the self-adjuster operable to access the knowledge repository, 
the self-adjuster operable to transmit data to effectors, and the 
self-adjuster operable to plan and execute, an environment 
monitor that is operable to receive information from sensors 
and operable to monitor and analyze the sensor information 
and access the knowledge repository, and an autonomic man- 
ager communications component operably coupled to the 
environment monitor in an environment control loop, the 
autonomic manager communications component operable to 
access the knowledge repository, the autonomic manager 
communications component also operable to produce and 
transmit a counteracting signal to an incoming harmful sig- 
nal. 

In yet other embodiments, an autonomic system includes a 
plurality of autonomic agents performing one or more pro- 
grammed tasks. The autonomic system also includes a coor- 
dinating autonomic agent for assigning programmed task and 
for issuing instructions to the plurality of autonomic agents. 
The autonomic system also includes a messenger autonomic 
agent for facilitating communication between the coordinat- 
ing autonomic agent, plurality of autonomic agents, a remote 
system. One or more programmed task performed by the 
plurality of autonomic objects is at least generating signals 
indicative of a potentially harmful signal. The coordinating 
autonomic agent transmits a neutralizing data signal to one or 
more of the plurality of autonomic agents, based on the gen- 
erated signals. 

In still yet other embodiments, an autonomous nanotech- 
nology swarm includes a first worker composed of self-simi- 
lar autonomic components. The autonomous nanotechnology 
swarm also includes a second worker composed of self-simi- 
lar autonomic components. The autonomous nanotechnology 
swarm also includes a third worker composed of self-similar 
autonomic components. In the autonomous nanotechnology 
swarm, the third worker facilitates communication between 
the first worker and the second worker. In the autonomous 
nanotechnology swarm, the first worker generates a heart beat 
monitor signal and pulse monitor signal. In the autonomous 
nanotechnology swarm, the second worker includes an otoa- 
coustic component that is operable to counteract a harmful 
signal. 

In further embodiments, a method includes instantiating an 
embryonic evolvable neural interface. The method also 
includes evolving the embryonic evolvable neural interface 
towards complex complete connectivity. The evolvable neu- 
ral interface receives one or more heart beat monitor signal, 
pulse monitor signal, and neutralizing data signal. The evolv- 
able neural interface generates one or more heart beat monitor 
signal, pulse monitor signal, and neutralizing data signals. 
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In yet a further embodiment, a method for protecting an 
autonomic system when encountering one or more autonomic 
agents includes determining the potential harm of the auto- 
nomic agent. The method also includes sending a neutralizing 
data signal to the autonomic agent and monitoring the 5 
response of the autonomic agent the neutralizing data signal. 

In still yet a further embodiment, a system includes a 
processor and a storage device coupled to the processor. The 
system also includes software means operative on the proces- 
sor for sending a neutralizing data signal to the autonomic to 
agent, monitoring the response of the autonomic agent to the 
neutralizing data signal, and determining the autonomic 
agent potential for causing harm to the autonomic system. 

Systems, clients, servers, methods, and computer-readable 
media of varying scope are described herein. In addition to the 1 5 
aspects and advantages described in this summary, further 
aspects and advantages will become apparent by reference to 
the drawings and by reading the detailed description that 
follows. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. lisa block diagram that provides an overview of an 
evolvable synthetic neural system to manage collective inter- 
actions between autonomous entities, according to an 25 
embodiment of the invention; 

FIG. 2 is a block diagram of a neural basis function of a 
worker, according to an embodiment; 

FIG. 3 is a block diagram of a heuristic neural system, 
according to an embodiment; 30 

FIG. 4 is a block diagram of an autonomous neural system, 
according to an embodiment; 

FIG. 5 is a block diagram of a neural basis function of a 
worker, according to an embodiment; 

FIG. 6 is a block diagram of a multiple level hierarchical 35 
evolvable synthetic neural system, according to an embodi- 
ment; 

FIG. 7 is a block diagram of a conventional computer 
cluster environment in which different embodiments can be 
practiced; 40 

FIG. 8 is a block diagram of a conventional hardware and 
operating environment in which different embodiments can 
be practiced; 

FIG. 9 is a block diagram of a conventional multiprocessor 
hardware and operating environment in which different 45 
embodiments can be practiced; 

FIG. 10 is a block diagram of a hardware and operating 
environment, which includes a quiese component, according 
to an embodiment; 

FIG. 11 is a diagram of autonomous entities’ interaction, 50 
according to an embodiment; 

FIG. 12 is a block diagram of an autonomous entity man- 
agement system, according to an embodiment; 

FIG. 13 is a hierarchical chart of an autonomous entity 
management system, according to an embodiment; 55 

FIG. 14 is a block diagram of an autonomic element, 
according to an embodiment; 

FIG. 15 is a block diagram of autonomy and autonomicity 
at a high system level, according to an embodiment; 

FIG. 16 is a block diagram of an architecture of an auto- 60 
nomic element, according to an embodiment, that includes 
reflection and reflex layers; 

FIG. 17 is a flowchart of a method to construct an environ- 
ment to satisfy increasingly demanding external require- 
ments, according to an embodiment; 65 

FIG. 18 is a flowchart of a method to construct an environ- 
ment to satisfy increasingly demanding external require- 
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ments, according to an embodiment, where a ruler entity 
decides to withdraw or generate a stay alive signal; 

FIG. 19 is a flowchart for a generating stay-alive signal 
when a warning condition occurs, according to an embodi- 
ment; 

FIG. 20 is a flowchart of a method to construct an environ- 
ment to satisfy increasingly demanding external require- 
ments, according to an embodiment, where a ruler entity 
decides to withdraw or generate a stay -awake signal; 

FIG. 21 is a flowchart for generating neutralizing data 
signal when a warning condition occurs, according to an 
embodiment; 

FIG. 22 is a flowchart for interrogating an anonymous 
autonomic agent, according to an embodiment; 

FIG. 23 is a flowchart of a method of autonomic commu- 
nication by an autonomic element, according to an embodi- 
ment; 

FIG. 24 is a flowchart of a method of autonomic commu- 
nication by an autonomic element, according to an embodi- 
ment; 

FIG. 25 is a flowchart of a method of autonomic commu- 
nication by an autonomic element, according to an embodi- 
ment; and 

FIG. 26 is a flowchart of a method of autonomic commu- 
nication by an autonomic element, according to an embodi- 
ment. 

DETAILED DESCRIPTION OF THE INVENTION 

In the following detailed description, reference is made to 
the accompanying drawings that form a part hereof, and in 
which is shown by way of illustration specific embodiments 
that can be practiced. These embodiments are described in 
sufficient detail to enable those skilled in the art to practice the 
embodiments, and it is to be understood that other embodi- 
ments can be utilized and that logical, mechanical, electrical 
and other changes can be performed without departing from 
the scope of the embodiments. The following detailed 
description is, therefore, not to be taken in a limiting sense. 

The detailed description is divided into six sections. In the 
first section, a system level overview is described. In the 
second section, apparatus are described. In the third section, 
hardware and the operating environments in conjunction with 
which embodiments can be practiced are described. In the 
fourth section, particular implementations are described. In 
the fifth section, embodiments of methods are described. 
Finally, in the sixth section, a conclusion of the detailed 
description is provided. 

System Level Overview 

FIG. 1 is a block diagram that provides an overview of an 
evolvable synthetic neural system to manage collective inter- 
actions between autonomous entities, according to an 
embodiment. System 100 can include a first plurality of neu- 
ral basis functions (NBFs) 102 and 104. NBFs are the funda- 
mental building block of system 100. In some embodiments 
of system 100, the plurality of NBFs includes more than the 
two NBFs 102 and 104 shown in FIG. 1. In some embodi- 
ments, system 100 includes only one NBF. One embodiment 
of a NBF is described below with reference to FIG. 2. 

System 100 can also include a first inter-evolvable neural 
interface (ENI) 106 that is operably coupled to each of the 
first plurality of neural basis functions. The NBFs 102 and 
104 can be highly integrated, and coupling between the NBFs 
through the ENI 106 provides a three dimensional complex- 
ity. Thus, for example, when system 100 is implemented on 
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microprocessors such as microprocessor 804 described 
below with reference to FIG. 8, system 100 can provide a 
synthetic neural system that reconciles the two dimensional 
nature of microprocessor technologies to the three dimen- 
sional nature of biological neural systems. 5 

This embodiment of the inter-ENI 106 can be known as an 
inter-NBF ENI because the inter-ENI 106 is illustrated as 
being between or among the NBFs 102 and 104 at the same 
level within a hierarchy. System 100 shows only one level 108 
of a hierarchy, although one skilled in the art will recognize 
that multiple hierarchies can be used within the scope of this 
invention. 

System 100 can also operate autonomously. A system oper- 
ates autonomously when the system exhibits the properties of 1 5 
being self managing and self governing, often termed as 
autonomic, pervasive, sustainable, ubiquitous, biologically 
inspired, organic or with similar such terms. ENI 106 can 
adapt system 100 by instantiating new NBFs and ENIs and 
establishing operable communi cation paths 110 to the new 20 
NBFs and the ENIs to system 100. ENI 106 can also adapt 
system 100 by removing or disabling the operable communi- 
cation paths 110 to the new NBFs and ENIs. The adapting, 
establishing, removing and disabling of the communication 
paths 110 can be performed autonomously. Thus, system 100 25 
can satisfy the need for a synthetic neural system that per- 
forms significant tasks with complete autonomy. 

System 100 can be capable of establishing and removing 
links to other similarly configured systems (not shown). Thus, 
the system 100 can be described as self- similar. 30 

The system level overview of the operation of an embodi- 
ment is described in this section of the detailed description. 
Some embodiments can operate in a multi -processing, multi- 
threaded operating environment on a computer, such as com- 
puter 802 in FIG. 8. 35 

While the system 100 is not limited to any particular NBF 
or ENI, for sake of clarity simplified NBFs and a simplified 
ENI are described. 

Apparatus Embodiments 40 

In the previous section, a system level overview of the 
operation of an embodiment is described. In this section, 
particular apparatus of such an embodiment are described by 
reference to a series of block diagrams. Describing the appa- 45 
ratus by reference to block diagrams enables one skilled in the 
art to develop programs, firmware, or hardware, including 
such instructions to implement the apparatus on suitable com- 
puters, and executing the instructions from computer-read- 
able media. 50 

In some embodiments, apparatus 200-600 are imple- 
mented by a program executing on, or performed by firmware 
or hardware that is a part of a computer, such as computer 802 
in FIG. 8. 

FIG. 2 is a block diagram of a neural basis function (NBF) 55 
200 of a worker according to an embodiment. NBF 200 is 
illustrated as a bi-level neural system because both high-level 
functions and low-level functions are performed by NBF 200. 

NBF 200 can include an intra-evolvable neural interface 
(intra-ENI) 202. The ENI 202 can be operably coupled to a 60 
heuristic neural system (HNS) 204 and operably coupled to 
an autonomous neural system (ANS) 206. The HNS 204 can 
perform high-level functions and the ANS 206 performs low- 
level functions that are often described as “motor functions” 
such as “motor” 1510 in FIG. 15 below. In NBF 200, the HNS 65 
204 and the ANS 206 in aggregate can provide a function of 
a biological neural system. The intra-ENI 202 shown in FIG. 
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2 is an ENI that is wholly contained within an NBF, and is 
therefore prefixed with “intra.” 

The intra-ENI 202 can send action messages to and receive 
request messages from the HNS 204 and the ANS 206 during 
learning and task execution cycles, as well as during interfac- 
ing operations between the intra-ENI and the HNS 204 and 
the ANS 206 when the HNS 204 and the ANS 206 need to be 
modified as a result of other system failures or modification of 
objectives. NBF 200 is illustrated as a worker NBF because 
this NBF performs functions, but does not provide instruc- 
tions commands to other NBFs. 

FIG. 3 is a block diagram of a heuristic neural system 300 
according to an embodiment. 

The heuristic neural system (HNS) 300 can be composed 
of a neural net 302 for pattern recognition and a fuzzy logic 
package 304 to perform decisions based on recognitions. 
Taken together the neural net 302 and the fuzzy logic package 
304 can form a basis for a higher level heuristic intelligence. 

FIG. 4 is a block diagram of an autonomous neural system 
400 according to an embodiment. 

The autonomous neural system (ANS) 400 can include a 
non-linear dynamics simulation 402 that represents smart 
servo system behavior. 

FIG. 5 is a block diagram of a neural basis function (NBF) 
500 of a worker according to an embodiment. NBF 500 is 
shown as a bi -level neural system. 

In some embodiments, NBF 500 can include a self assess- 
ment loop (SAL) 502 at each interface between autonomic 
components. Each SAL 502 can continuously gauge effi- 
ciency of operations of the combined HNS 204 and ANS 206. 
The standards and criteria of the efficiency can be set or 
defined by objectives of the NBF 500. 

In some embodiments, NBF 500 can also include genetic 
algorithms (GA) 504 at each interface between autonomic 
components. The GAs 504 can modify the intra-ENI 202 to 
satisfy requirements of the SALs 502 during learning, task 
execution or impairment of other subsystems. 

Similarly, the HNS 204 can have a SAL 502 interface and 
a GA 504 interface to a core heuristic genetic code (CHGC) 
506, and the ANS 206 can have a SAL 502 interface and a GA 
504 interface to a core autonomic genetic code (CAGC) 508. 
The CHGC 506 and CAGC 508 can allow modifications to a 
worker functionality in response to new objectives or injury. 
The CHGC 506 and the CAGC 508 autonomic elements can 
not be part of an operational neural system, but rather can 
store architectural constraints on the operating neural system 
for both parts of the bi-level system. The CHGC 506 and the 
CAGC 508 can both be modifiable depending on variations in 
sensory inputs via GAs 504. 

In some embodiments, the CHGC 506 and the CAGC 508 
in conjunction with SALs 502 and GAs 504 can be general- 
ized within this self similar neural system to reconfigure the 
relationship between NBFs as well as to permit the instantia- 
tion of new NBFs to increase the overall fitness of the neural 
system. Thus, NBF 500 can provide a form of evolution 
possible only over generations of BNF workers. 

In some embodiments, NBF 500 can also include genetic 
algorithms 510 and 512 that provide process information to 
the CHGC 506 and the CAGC 508, respectively. HNS 204 
and ANS 206 can receive sensory input 514 and 516, respec- 
tively, process the sensory input and generate high level 
actions 518 and low level actions 520, respectively. 

FIG. 6 is a block diagram of a multiple level hierarchical 
evolvable synthetic neural system (ESNS) 600 according to 
an embodiment. 

The multiple level hierarchical ESNS 600 can include a 
first level of hierarchy 602 that includes a NBF 604 and 
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inter-ENI 606 andarulerNBF 608. A ruler NBF, such as ruler 
NBF 608 can perform functions and also provide instructions 
commands to other subordinate NBFs. 

The ruler NBF 608 of the first hierarchical level 602 is 
illustrated as being operably coupled to a ruler NBF 610 in a 
second hierarchical level 612. Ruler NBF 610 can perform 
functions, receive instructions and commands from other 
ruler NBFs that are higher in the hierarchy of the ESNS 600 
and also provide instructions commands to other subordinate 
NBFs. 

The second hierarchical level 612 can also include an inter- 
ENI 614. The second hierarchical level 612 of FIG. 6 shows 
the embodiment of an ESNS 600 having one NBF operably 
coupled to an ENI. The ruler NBF 610 of the second hierar- 
chical level 612 can be operably coupled to a ruler NBF 616 
in a third hierarchical level 618. 

The third hierarchical level 616 can also include an inter- 
ENI 620. The third hierarchical level 616 of FIG. 6 shows the 
embodiment of an ESNS 600 having more than two NBFs 
(e.g. 616, 622 and 624) operably coupled to an ENI. 

In some embodiments, the NBFs 604, 608, 610, 616, 622 
and 624 can include the aspects of NBFs 102 and 104 in FIG. 
1 above, and/or NBF 200 in FIG. 2 above. One skilled in the 
art will appreciate that many combinations exist that fall 
within the purview of this invention. 

Hardware and Operating Environments 

FIGS. 7, 8, 9 and 10 are diagrams of hardware and operat- 
ing environments in which different embodiments can be 
practiced. The description of FIGS. 7, 8, 9 and 10 provide an 
overview of computer hardware and suitable autonomic com- 
puting environments in conjunction with which some 
embodiments can be implemented. Embodiments are 
described in terms of a computer executing computer-execut- 
able instructions. However, some embodiments can be imple- 
mented entirely in computer hardware in which the computer- 
executable instructions are implemented in read-only 
memory. Some embodiments can also be implemented in 
client/server autonomic computing environments where 
remote devices that perform tasks are linked through a com- 
munications network. Program modules can be located in 
both local and remote memory storage devices in a distributed 
autonomic computing environment. Those skilled in the art 
will know that these are only a few of the possible computing 
environments in which the invention can be practiced and 
therefore these examples are given by way of illustration 
rather than limitation. 

FIG. 7 is a block diagram of a computer cluster environ- 
ment 700 in which different embodiments can be practiced. 
System 100, apparatus 200, 300, 400, 500, 600, method 2000 
and ESNS 1100 and 1200 can be implemented on computer 
cluster environment 700. 

Computer cluster environment 700 can include a network 
702, such as an EtherFast 10/100 backbone, that is operably 
coupled to a cluster server 704 and a plurality of computers 
706, 708, 710 and 712. One possible embodiment of the 
computers is computer 802 described below with reference to 
FIG. 8. The plurality of computers can include any number of 
computers, but some implementations can include 7, 16, 32 
and as many as 512 computers. The ESNSs and NBFs 
described above can be distributed on the plurality of com- 
puters. 

One example of the computer cluster environment 700 is a 
Beowolf computer cluster. The computer cluster environment 
700 provides an environment in which a plurality of ESNSs 
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and NBFs can be hosted in an environment that facilitates 
cooperation and communication between the ESNSs and the 
NBFs. 

FIG. 8 is a block diagram of a hardware and operating 
5 environment 800 in which different embodiments can be 
practiced. Computer 802 can include a processor 804, which 
can be a microprocessor, commercially available from Intel, 
Motorola, Cyrix and others. Computer 802 can also include 
random-access memory (RAM) 806, read-only memory 
to (ROM) 808, and one or more mass storage devices 810, and a 
system bus 812, that operatively couples various system com- 
ponents to the processing unit 804. The memory 806, 808, 
and mass storage devices, 810, are illustrated as types of 
computer-accessible media. Mass storage devices 810 can be 
15 more specifically types of nonvolatile computer- accessible 
media and can include one or more hard disk drives, floppy 
disk drives, optical disk drives, and tape cartridge drives. The 
processor 804 can execute computer programs stored on the 
computer-accessible media. 

20 Computer 802 can be communicatively connected to the 
Internet 814 via a conmiunication device 816. Internet 814 
connectivity is well known within the art. In one embodiment, 
a communication device 81 6 can be a modem that responds to 
communication drivers to connect to the Internet via what is 
25 known in the art as a “dial-up connection.” In another embodi- 
ment, a communication device 816 can be an Ethernet® or 
similar hardware network card connected to a local-area net- 
work (LAN) that itself is connected to the Internet via what is 
known in the art as a “direct connection” (e.g., T1 line, etc.). 
30 A user can enter commands and information into the com- 
puter 802 through input devices such as a keyboard 818 or a 
pointing device 820. The keyboard 818 can permit entry of 
textual information into computer 802, as known within the 
art, and embodiments are not limited to any particular type of 
35 keyboard. Pointing device 820 can permit the control of the 
screen pointer provided by a graphical user interface (GUI) of 
operating systems such as versions of Microsoft Windows®. 
Embodiments are not limited to any particular pointing 
device 820. Such pointing devices can include mice, touch 
40 pads, trackballs, remote controls and point sticks. Other input 
devices (not shown) could include a microphone, joystick, 
game pad, satellite dish, scanner, or the like. 

In some embodiments, computer 802 can be operatively 
coupled to a display device 822. Display device 822 can be 
45 connected to the system bus 812. Display device 822 permits 
the display of information, including computer, video and 
other information, for viewing by a user of the computer. 
Embodiments are not limited to any particular display device 
822. Such display devices can include cathode ray tube (CRT) 
50 displays (monitors), as well as flat panel displays such as 
liquid cry stal displays (LCDs). In addition to a monitor, com- 
puters can typically include other peripheral input/output 
devices such as printers (not shown). Speakers 824 and 826 
provide audio output of signals. Speakers 824 and 826 can 
55 also be connected to the system bus 812. 

Computer 802 can also include an operating system (not 
shown) that could be stored on the computer-accessible 
media RAM 806, ROM 808, and mass storage device 810, 
and can be and executed by the processor 804. Examples of 
60 operating systems include Microsoft Windows®, Apple 
MacOS®, Linux®, UNIX®. Examples are not limited to any 
particular operating system, however, and the construction 
and use of such operating systems are well known within the 
art. 

65 Embodiments of computer 802 are not limited to any type 
of computer 802. In varying embodiments, computer 802 can 
comprise a PC-compatible computer, a MacOS®-compatible 
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computer, a Linux®-compatible computer, or a UNIX®- 
compatible computer. The construction and operation of such 
computers are well known within the art. 

Computer 802 can be operated using at least one operating 
system to provide a graphical user interface (GUI) including 
a user-controllable pointer. Computer 802 can have at least 
one web browser application program executing within at 
least one operating system, to permit users of computer 802 to 
access an intranet, extranet or Internet world-wide-web pages 
as addressed by Universal Resource Locator (URL) 
addresses. Examples of browser application programs 
include Netscape Navigator® and Microsoft Internet 
Explorer®. 

The computer 802 can operate in a networked environment 
using logical connections to one or more remote computers, 
such as remote computer 828. These logical connections can 
be achieved by a communication device coupled to, or a part 
of, the computer 802. Embodiments are not limited to a par- 
ticular type of communications device. The remote computer 
828 could be another computer, a server, a router, a network 
PC, a client, a peer device or other common network node. 
The logical connections depicted in FIG. 8 include a local- 
area network (LAN) 830 and a wide-area network (WAN) 
832. Such networking environments are commonplace in 
offices, enterprise-wide computer networks, intranets, extra- 
nets and the Internet. 

When used in a LAN-networking environment, the com- 
puter 802 and remote computer 828 can be connected to the 
local network 830 through network interfaces or adapters 
834, which is one type of communications device 816. 
Remote computer 828 can also include a network device 836. 
When used in a conventional WAN-networking environment, 
the computer 802 and remote computer 828 can communicate 
with a WAN 832 through modems (not shown). The modem, 
which can be internal or external, is connected to the system 
bus 812. In a networked environment, program modules 
depicted relative to the computer 802, or portions thereof, can 
be stored in the remote computer 828. 

Computer 802 can also include power supply 838. Each 
power supply can be a battery. 

FIG. 9 is a block diagram of a multiprocessor hardware and 
operating environment 900 in which different embodiments 
can be practiced. Computer 902 can include a plurality of 
microprocessors, such as microprocessor 804, 904, 906, and 
908. The four microprocessors of computer 902 can be one 
example of a multi-processor hardware and operating envi- 
ronment; other numbers of microprocessors can be used in 
other embodiments. 

Similar to the computer cluster environment 700 in FIG. 7 
above, the computer 902 can provide an environment in 
which a plurality of ESNSs and NBFs can be hosted in an 
environment that facilitates cooperation and communication 
between the ESNSs and the NBFs. 

FIG. 10 is a block diagram of a hardware and operating 
environment 1000 which can include a quiese component, 
according to an embodiment. The hardware and operating 
environment 1000 reduces the possibility that an autonomic 
element will jeopardize the mission of the autonomic unit. 

A quiesce component 1002 of an autonomic unit can ren- 
der the autonomic unit inactive for a specific amount of time 
or until a challenging situation has passed. The quiesce com- 
ponent 1002 can be invoked when either an external supervi- 
sory entity or the autonomic unit itself determines that the 
autonomic unit could best serve the needs of the swarm by 
quiescing. Quiescing can render the autonomic unit tempo- 
rarily inactive or disabled. Thus, the quiesce component 1002 
can reduce the possibility that an autonomic element will 
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jeopardize the mission of the autonomic element by deacti- 
vation or inactivating the autonomic element. 

Quiesce time can be defined as the length of time taken to 
quiesce a system (to render the system inactive), or the length 
5 of time between periods of activity (i.e. the length of time of 
inactivity). The quiescing can be somewhat analogous to the 
cell lifecycle, were cells can stop dividing and go into a 
quiescent state. 

Components of the system 100, apparatus 200, 300, 400, 
10 500, 600, 1000, 1400, 1200, 1300, 1400, 1500 and 1600 and 
methods 1700, 1800, 1900, 2000, 2100, 2200, 2300, 2400, 
2500 and 2600 can be embodied as computer hardware cir- 
cuitry or as a computer-readable program, or a combination 
of both. 

15 More specifically, in one computer-readable program 
embodiment, the programs can be structured in an object- 
orientation using an object-oriented language such as Java, 
Smalltalk or C++, and the programs can be structured in a 
procedural-orientation using a procedural language such as 
20 COBOL or C. The software components can communicate in 
any of a number of ways that are well-known to those skilled 
in the art, such as application program interfaces (API) or 
interprocess communication techniques such as remote pro- 
cedure call (RPC), common object request broker architec- 
25 ture (CORBA), Component Object Model (COM), Distrib- 
uted Component Object Model (DCOM), Distributed System 
Object Model (DSOM) and Remote Method Invocation 
(RMI). The components execute on as few as one computer as 
in computer 802 in FIG. 8, or on at least as many computers 
30 as there are components. 

Implementation of an Evolvable Synthetic Neural 
System in a Tetrahedral Architecture 

35 FIG. 11 is a diagram representation of a plurality of auto- 
nomic entities that have been assembled to perform a task. 
These entities can be self-configuring: adapt automatically to 
the dynamically changing environments; self-optimizing: 
monitor and tune resources automatically; self-protecting: 
40 anticipate, detect, identify, and protect against attacks from 
anywhere; and, self-healing: discover, diagnose, and react to 
disruptions. As shown with reference to autonomic entities 
1118 and 1120 autonomic computing can have a self-aware 
layer and an environment aware layer. The self-aware layer of 
45 the autonomic entity (agent or other) can be comprised of a 
managed component and autonomic manager, which can be 
an agent, termed a self-managing cell (SMC). Control loops 
with sensors (self-monitor) and effectors (self-adjuster) 
together with system knowledge and planning/adapting poli- 
50 cies can allow the autonomic entities to be self aware and to 
self manage. A similar scheme can facilitate environment 
awareness — allowing self managing if necessary, but without 
the immediate control to change the environment; this could 
be affected through communication with other autonomic 
55 managers that have the relevant influence, through reflex or 
event messages. The autonomic entities can be arranged or 
assigned distinctive roles such as worker entities, coordinat- 
ing or managing entities, and message entities. Based on the 
task a ruler entity could be assigned a set of worker entities to 
60 manage inclusive of determining if a stay alive signal ought to 
be withdrawn. Further, the communication between the ruler 
and the worker can be facilitated through the message entity. 
The message entity could have the additional task of commu- 
nicating with a remote system. In the case of space explora- 
65 tion, the remote system could be mission control on earth, 
mission control on an orbital platform, or any other arrange- 
ment that can facilitate that is external to the collection of 



US 8,165,977 B2 


11 

autonomic elements. The remote system could be an auto- 
nomic entity acting like the project manager for the mission. 
Communication with mission control will be limited to the 
download of science data and status information. An example 
of such a grouping is shown in FIG. 11 where autonomic 5 
entity 1102 is shown as a ruler entity, autonomic entity 1110 
as a message entity, and autonomic entities 1118 and 1120 are 
examples of worker entities. In terms of hardware, these 
entities can be all identical with the discernable difference 
being programming to accomplish assigned tasks. An added 10 
advantage to having identical hardware is replacing failed 
entities, which can be accomplished by activating software 
code found in the autonomic entity. If hardware differences 
exist they can be based on specialized equipment suitable for 
a particular task. However, at a minimum, certain functions or 15 
roles, such as ruler and messenger, can be expected to be 
within the skill set of all the autonomic entities. 

As shown in FIG. 11, ruler autonomic entity 1102 can 
comprise a program or process 1104 executing in ruler entity 
1102. Ruler entity 1102 can be implemented using a data 20 
processing system, such as data processing system 902 in 
FIG. 9, or in the form of an autonomous agent compiled by a 
data processing system. In the alternative, the ruler entity 
could be an autonomous nano -teclino logy swarm that is 
launched from a factory ship for exploring planets, asteroids, 25 
or comets. Further, an analysis module 1106 or agent as 
executed by ruler entity 1102 can be used to monitor process 
1104 and to receive pulse monitor and heart beat monitor 
signals from worker entities through the messenger entity. 
When the analysis module 1106 is used to monitor process 30 
1104 the analysis module 1106 can be to detect errors or 
problems with the operation of process 1104. 

As shown in FIG. 11, analysis agent 1106 can include an 
evaluator or other monitoring engine used to monitor the 
operation of process 1104. Analysis agent 1106 can be 35 
executed in response to some event. This event can be a 
periodic event, such as the passage of some period of time, 
data received from one or more of the worker entities. Further, 
the event can be the initialization of internal procedures in 
proces s 1 1 04 or the starting or restarting of ruler entity 1102. 40 
Depending on the particular implementation, analysis agent 
1106 can continuously run in the background monitoring 
process 1104 and analyzing the worker entity signals. See 
method 2100 in FIG. 21 below for actions taken by analysis 
agent module 1106 in formulating a strategy for the worker 45 
entities. Further, analysis agent 1106 can be subject to any 
self-healing routines found in ruler entity 1102. 

This monitoring by analysis agent 1106 can be based on 
rules stored in behavior storage 1108, which could be used to 
compare the actual behavior of the received data to an 50 
expected behavior as defined in behavior storage 1108. In the 
present arrangement, behavior storage 1108 (ruler entity 
1102) can be a collection of rules that can be updated by a 
remote computer through the messenger entity that reflects 
most current fixes (self-healing) or repair procedures and 55 
responses to worker entities upon the occurrence of an event, 
change in condition, or deviation from a normal operation. 
Behavior storage 1108 can be narrowly tailored based on the 
use and purpose of the autonomic entity, such as messenger 
entity 1110 and have only those procedures needed to per- 60 
form its programming. 

When messenger entity connects to remote computer at a 
command and control station, database 1116 can be updated 
with information that can later be used to program ruler entity 
or worker entity. In most cases a copy of the rules in database 65 
1116 contains the most up-to-date information. If the objec- 
tive changes or a solution to a problem requires an updated 
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version not found within the autonomic entity, the entities can 
attempt to contact message entity 1 1 1 0 to see if more recent or 
up-to-date information is available. If updates are available, 
these updates can be sent to the requesting entity for process- 
ing. 

The information in behavior storage 1108 and databases in 
messenger and worker entity can include an array of values 
that are expected when selected process or operations are 
implemented in the respective entity. Examples processes can 
be initializing software, timing requirements, synchroniza- 
tion of software modules, and other metrics that can provide 
information concerning the running of a process within the 
respective entity. Examples operations can be data gathering, 
processing of information, controlling machinery, or any 
other operation where data processing systems are employed. 
These expected values can be compared to determine if an 
error condition has occurred in the operation of the entity. An 
error condition can be analyzed to determine its causes and 
possible correction. In the case of a worker entity, the error 
can be internally analyzed to select the appropriate self-heal- 
ing procedure and the error can be sent to the ruler entity to be 
analyzed by analysis agent 1106 using the rules in behavior 
storage 1108. Based on the analysis, the ruler entity can elect 
to either withdraw the stay alive signal to the malfunctioning 
worker entity or wait a selected period to generate one or more 
stay alive signal, withdrawal of a stay alive signal, or a self- 
destruct signal. If the stay alive signal is withdrawn, the 
malfunctioning entity could be disconnected from the opera- 
tion and the assigned to another entity or partially performed 
by the remaining entity to insure its completion. 

FIG. 12 is a block diagram of an autonomous entity man- 
agement system 1200 according to an embodiment. The sys- 
tem 1200 can be a generic system because the system 1200 
represents a myriad of devices, processes, or device and pro- 
cess that perform a task in accordance to its programming or 
design. The illustrated system 1200 represents an instance 
when an autonomous system 1204 encounters an anonymous 
autonomic agent 1202. An anonymous autonomous agent can 
be a visiting agent, a mobile agent that can enter the sphere of 
influence of the autonomous system 1204, or any device for 
which the autonomous system 1204 has no established rela- 
tionship. Example encounters can be a wireless device 
(agent) and communication tower (system), a client and 
server, a video subscriber and video provider, a process and an 
operating system. System 1200 manages autonomous entities 
that can be functionally extracted from an environment upon 
the occurrence of a predetermined condition such as a poten- 
tial security breach. 

The autonomous system 1204 can comprise one or more 
autonomic agents 1208, 1210, and 1212 all performing 
assigned functions and roles. As noted earlier, roles can be a 
combination of ruler, messenger, and worker. Functions can 
be data gathering, communication functions, scheduling, 
controlling, security, and so forth. Upon detecting anony- 
mous autonomic agent 1202 the assigned autonomous agent 
for performing security functions for autonomous system 
1204 can interrogate the anonymous autonomic agent 1202, 
requesting production of valid credentials. Detection can 
occur by employing various schemes such as when the anony- 
mous autonomic agent 1202 requests resources from the sys- 
tem 1204 or from any autonomic entity that forms part of the 
system, response to polling signals from the autonomous 
system 1204, or through a friend or foe signal that indicates 
the presence of an anonymous entity 1202 in proximity to the 
autonomous system 1204. 

To the autonomous system 1204, security can be important 
because of compromises by the accidental misuse of hosts by 
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agents, as well as the accidental or intentional misuse of 
agents by hosts and agents by other agents. The result can be 
damage, denial-of-service, breach-of-privacy, harassment, 
social engineering, event-triggered attacks, or compound 
attacks. To prevent security breaches, visiting agents can be 
verified to have valid and justified reasons for being there as 
well as providing security to the visiting agent with interac- 
tion with other agents and host. Upon detection the visiting 
agent 1202 can be sent an asynchronous ALice signal (Auto- 
nomic license) 1206 requiring valid credentials from the 
agent 1202. The anonymous agent 1202 can need to work 
within the autonomic system 1204 to facilitate self-manage- 
ment, as such the anonymous agent 1202 and its host can need 
to be able to identify each other’s credentials through such as 
an ALice signal. The autonomic system 1204 can establish 
certain response characteristics for the returned signal from 
the agent 1202. For example, the autonomic system 1204 can 
require a response in an appropriate format, within a certain 
timeout period, and with a valid and justified reason for being 
within the locust of interest or domain of the autonomous 
system 1204. For protection the autonomic system 1204 can 
make an assessment of the quality of the response from the 
anonymous agent 1202 to ascertain the potential of the agent 
for causing harm to the autonomous system 1204. Based on 
this determination the autonomous system 1204 can control 
the type of interaction with the agent 1202. The agent can be 
destroyed, blocked, partially blocked, stay alive signal with- 
drawn, or allowed to communicate with other agents within 
the autonomous system 1204. The protection can be triggered 
at any level of infraction or by a combination of infractions by 
the anonymous autonomous agent 1202 when responding to 
the ALice signal. If the agent 1202 fails to identify itself 
appropriately following an ALice interrogation, the agent 
1202 can be blocked from the system and given either a 
self-destruct signal, or its “stay alive” reprieve is withdrawn. 
A consequence of unacceptable response within a timeout 
period is that the anonymous agent 1202 can be identified as 
an intruder or other invalid agent (process) and consequently, 
the anonymous agent 1202 is destroyed and/or excluded from 
communicating with other agents 1208, 1210, 1212 in the 
system. As an alternative to the ALice signal, a quiese signal, 
command or instruction can be sent. The quiesce signal is 
discussed in more detail in conjunction with FIGS. 10, 19 and 
20. 

FIG. 13 is a hierarchical chart of an autonomous entity 
management system 1300 according to an embodiment. 
Properties that a system can possess in order to constitute an 
autonomic system are depicted in the autonomous entity 
management system 1300. 

General properties of an autonomic (self-managing) sys- 
tem can include four objectives defined by International Busi- 
ness Machines 1302: self-configuring 1304, self-healing 
1306, self-optimizing 1308 and self-protecting 1310, and 
four attributes 1312: self-awareness 1314, environment- 
awareness 1316, self-monitoring 1318 and self-adjusting 
1320. One skilled in the art will recognize that other proper- 
ties also exist, such as self-quiescing 1324. Essentially, the 
objectives 1302 could represent broad system requirements, 
while the attributes 1312 identify basic implementation 
mechanisms. 

Self-configuring 1304 can represent an ability of the sys- 
tem 1300 to re-adjust itself automatically; this can simply be 
in support of changing circumstances, or to assist in self- 
healing 1306, self-optimization 1308 or self-protection 1310. 
Self-healing 1306, in reactive mode, is a mechanism con- 
cerned with ensuring effective recovery when a fault occurs, 
identifying the fault, and then, where possible, repairing it. In 
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proactive mode, the self-healing 1306 objective can monitor 
vital signs in an attempt to predict and avoid “health” prob- 
lems (i.e. reaching undesirable situations). 

Self-optimization 1308 can mean that the system 1300 is 
5 aware of ideal performance of the system 1300, can measure 
current performance of the system 1300 against that ideal, 
and has defined policies for attempting improvements. The 
system 1300 can also react to policy changes within the 
system as indicated by the users. A self-protecting 1310 sys- 
10 tern 1300 can defend the system 1300 from accidental or 
malicious external attack, which necessitates awareness of 
potential threats and a way of handling those threats. 

Self-managing objectives 1302 can require awareness of 
an internal state of the system 1300 (i.e. self-aware 1314) and 
15 current external operating conditions (i.e. environment-aware 
1316). Changing circumstances can be detected through self- 
monitoring and adaptations are made accordingly (i.e. self- 
adjusting 1320). Thus, system 1300 can have knowledge of 
available resources, components, performance characteris- 
20 tics and current status of the system, and the status of inter- 
connections with other systems, along with rules and policies 
therein can be adjusted. Such ability to operate in a hetero- 
geneous environment can require the use of open standards to 
enable global understanding and communication with other 
25 systems. 

These mechanisms may not be independent entities. For 
instance, if an attack is successful, this can include self- 
healing actions, and a mix of self-configuration and self- 
optimisation, in the first instance to ensure dependability and 
30 continued operation of the system, and later to increase the 
self-protection against similar future attacks. Finally, these 
self-mechanisms could ensure there is minimal disruption to 
users, avoiding significant delays in processing. 

Other self* properties have emerged or have been revisited 
35 in the context of autonomicity. We highlight some of these 
briefly here. Self-* 1322 can be self-managing properties, as 
follows. Self-anticipating is an ability to predict likely out- 
comes or simulate self-* actions. Self-assembling is an 
assembly of models, algorithms, agents, robots, etc.; self- 
40 assembly is often influenced by nature, such as nest construc- 
tion in social insects. Self-assembly is also referred to as 
self-reconfigurable systems. Self-awareness is “know thy- 
self’ awareness of internal state; knowledge of past states and 
operating abilities. Self-chop is the initial four self-properties 
45 (Self-Configuration 1304, Self-Healing 1306, Self-Optimisa- 
tion 1308 and Self-Protection 1310). Self-configuring is an 
ability to configure and re-configure in order to meet policies/ 
goals. Self-critical is an ability to consider if policies are 
being met or goals are being achieved (alternatively, self- 
50 reflect). Self-defining is a reference to autonomic event mes- 
sages between Autonomic Managers: contains data and defi- 
nition of that data-metadata (for instance using XML). In 
reference to goals/policies: defining these (from self-reflec- 
tion, etc.). Self-governing is autonomous: responsibility for 
55 achieving goals/tasks. Self-healing is reactive (self-repair of 
faults) and proactive (predicting and preventing faults). Self- 
installing is a specialized form of self-configuration — install- 
ing patches, new components, etc or re-installation of an 
operating system after a major crash. Self-managing is 
60 autonomous, along with responsibility for wider self-* man- 
agement issues. Self-optimizing is optimization of tasks and 
nodes. Self-organized is organization of effort/nodes; par- 
ticularly used in networks/communications. Self-protecting 
is an ability of a system to protect itself. Self-reflecting is an 
65 ability to consider if routine and reflex operations of self-* 
operations are as expected and can involve self-simulation to 
test scenarios. Self-similar is self-managing components ere- 
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ated from similar components that adapt to a specific task, for 
instance a self-managing agent. Self-simulation is an ability 
to generate and test scenarios, without affecting the live sys- 
tem. Self-aware is self-managing software, firmware and 
hardware. 5 

FIG. 14 is a block diagram of an autonomic element 1400 
according to an embodiment. Autonomic element 1400 can 
include an element 1402 that is operably coupled to sensors 
and 1404 and effectors 1406. 

Autonomic element 1400 can also include components that 10 
monitor 1408, execute 1410, analyze 1412 and plan 1414; 
those components can access knowledge 1416. Those com- 
ponents can interact with sensors 1418 and effectors 1420. 

FIG. 15 is a block diagram of autonomy and autonomicity 
1500 at a high system level, according to an embodiment. A 15 
high level perspective for an intelligent machine design is 
depicted in FIG. 15. This diagram of autonomy and autono- 
micity 1500 includes intelligent machine design and system 
level autonomy and autonomicity. 

FIG. 15 describes three levels for the design of intelligent 20 
systems: 

1) Reaction 1502 — the lowest level, where no learning 
occurs but there is immediate response to state information 
coming from sensory systems 1504. 

2) Routine 1506 — middle level, where largely routine 25 
evaluation and planning behaviors take place. Input is 
received from sensory system 1504 as well as from the reac- 
tion level and reflection level. This level of assessment results 

in three dimensions of affect and emotion values: positive 
affect, negative affect, and (energetic) arousal. 30 

3) Reflection 1508 — top level, receives no sensory 1504 
input or has no motor 1510 output; input is received from 
below. Reflection is a meta-process, whereby the mind delib- 
erates about itself. Essentially, operations at this level look at 
the system’s representations of its experiences, its current 35 
behavior, its current environment, etc. 

As illustrated, input from, and output to, the environment 
only takes place within the reaction 1502 and routine 1506 
layers. One can consider that reaction 1502 level essentially 
sits within the “hard” engineering domain, monitoring the 40 
current state of both the machine and its environment, with 
rapid reaction to changing circumstances; and, that the reflec- 
tion 1502 level can reside within an artificial domain utilizing 
its techniques to consider the behavior of the system and learn 
new strategies. The routine 1506 level can be a cooperative 45 
mixture of both. The high-level intelligent machine design 
can be appropriate for autonomic systems as depicted here in 
FIG. 15, in consideration of the dynamics of responses 
including reaction 1502 and also for reflection 1508 of self- 
managing behavior. 50 

As depicted autonomic computing can reside within the 
domain of the reaction 1502 layer as a result of a metaphoric 
link with the autonomic biological nervous system, where no 
conscious or cognitive activity takes place. Other biologi- 
cally-inspired computing (also referred to as nature-inspired 55 
computing, organic computing, etc.) can provide such higher 
level cognitive approaches for instance as in swarm intelli- 
gence. Within the autonomic computing research community, 
autonomicity can not normally be considered to imply this 
narrower view. Essentially, the autonomic self-managing 60 
metaphor can be considered to aim for a user/manager to be 
able to set high-level policies, while the system achieves the 
goals. Similar overarching views exist in other related initia- 
tives and, increasingly, they are influencing each other. 

In terms of autonomy and autonomicity, autonomy can be 65 
considered as being self-governing while autonomicity can 
be considered being self-managing. At the element level, an 


element can have some autonomy and autonomic properties, 
since to self-manage implies some autonomy, while to pro- 
vide a dependable autonomous element requires such auto- 
nomic properties as self-healing along with the element’s 
self-directed task. From this perspective, separation of 
autonomy and autonomicity as characteristics will decrease 
in the future and eventually will become negligible. On the 
other hand, at the system level if one considers again the three 
tiers of the intelligent machine design (reaction 1502, routine 
1506, and reflection 1508) and accepts the narrower view of 
autonomicity, there is a potential correlation between the 
levels. That is, the reaction 1502 level correlates with auto- 
nomicity, and the reflection 1508 level correlates with 
autonomy; autonomy as in self-governing of the self-manag- 
ing policies within the system. 

FIG. 16 is a block diagram of an architecture of an auto- 
nomic element (AE) 1600 according to an embodiment that 
includes reflection and reflex layers. The autonomic element 
1600 can include a managed component (MC) 1602 that is 
managed, and the autonomic element 1600 can further 
include an autonomic manager (AM), not shown. The AM 
can be responsible for the MC 1602 within the AE 1600. The 
AM can be designed as part of the component or provided 
externally to the component, as an agent, for instance. Inter- 
action of the autonomic element 1600 can occur with remote 
(external) autonomic managers (cf. the autonomic communi- 
cations channel 1606) through virtual, peer-to-peer, client- 
server or grid configurations. 

An important aspect of the architecture of many autonomic 
systems can be sensors and effectors, such as shown in FIG. 
14. A control loop 1608 can be created by monitoring 1610 
behavior through sensors, comparing this with expectations 
(knowledge 1416, as in historical and current data, rules and 
beliefs), planning 1612 what action is necessary (if any), and 
then executing that action through effectors. The closed loop 
of feedback control 1608 can provide a basic backbone struc- 
ture for each system component. FIG. 16 describes at least 
two control loops in the autonomic element 1600, one for 
self-awareness 1614 and another control loop 1608 for envi- 
ronmental awareness. 

In some embodiments, the self-monitor/self-adjuster con- 
trol loop 1614 can be substantially similar to the monitor, 
analyze, plan and execute (MAPE) control loop described in 
FIG. 14. The monitor-and-analyze parts of the structure can 
perform a function of processing information from the sen- 
sors to provide both self-awareness 1614 and an awareness 
1 608 of the external environment. The plan-and-execute parts 
can decide on the necessary self-management behavior that 
will be executed through the effectors. The MAPE compo- 
nents can use the correlations, rules, beliefs, expectations, 
histories, and other information known to the autonomic ele- 
ment, or available to the autonomic element through the 
knowledge repository 1416 within the AM 1604. 

A reflection component 1616 can perform analysis com- 
putation on the AE 1600 (cf. the reflection component 1616 
within the autonomic manager). In terms of an autonomic 
system, reflection can be particularly helpful in order to allow 
the system to consider the self-managing policies, and to 
ensure that the policies are being performed as expected. This 
can be important since autonomicity involves self-adaptation 
to the changing circumstances in the environment. An auto- 
nomic manager communications (AM/ AM) component 1618 
can also produce a reflex signal 1620. A self adjuster 1622 can 
be operably coupled to a self-monitor 1624 in the self control 
loop 1614. 


Method Embodiments 

In the previous section, apparatus embodiments are 
described. In this section, the particular methods of such 
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embodiments are described by reference to a series of flow- 
charts. Describing the methods by reference to a flowchart 
enables one skilled in the art to develop such programs, firm- 
ware, or hardware, including such instructions to carry out the 
methods on suitable computers, executing the instructions 
from computer-readable media. Similarly, the methods per- 
formed by the server computer programs, firmware, or hard- 
ware can also be composed of computer-executable instruc- 
tions. In some embodiments, methods 1700-2600 can be 
performed by a program executing on, or performed by firm- 
ware or hardware that is a part of a computer, such as com- 
puter 802 in FIG. 8. 

FIG. 17 is a flowchart of a method 1700 to construct an 
environment to satisfy increasingly demanding external 
requirements according to an embodiment where a ruler 
entity decides to withdraw or generate a stay alive signal. 
Method 1700 manages autonomous entities that can be func- 
tionally extracted from an environment upon the occurrence 
of a predetermined condition. 

Method 1700 can begin with action 1702 when receiving a 
signal from a managed entity. Action 1702 can receive a heart 
beat monitor (HBM) signal and pulse monitor (PBM) signal 
from a managed entity such as worker entities 1118 or 1120. 
The HBM signal can be an indication that the managed entity 
(worker entity) is operating. The HBM can be an “ON/OFF” 
state signal, an indication that a process is being performed, or 
any other signal that can convey information that the worker 
entity is alive or active. The PBM signal can extend the HBM 
signal to incorporate reflex/ urgency/health indicators from 
the autonomic manager representing its view of the current 
self-management state. The PBM signal can thus convey the 
performance and characteristics of the entity in the form of 
engineering data summarization to add context to the 
received HBM signal. Engineering data summarization can 
be a set of abstractions regarding sensor that can comprise rise 
and fall of data by a certain amount, external causes for 
parameter deviations, actual numerical value of the param- 
eters being summarized, warning conditions, alarm condi- 
tions, and any other summarization that would convey the 
general health of the system. Once the HBM and PBM signals 
have been received, control can be forwarded to action 1704 
for further processing. 

In action 1704, an analysis of the HBM and PBM signal 
can be performed to determine trends and possible areas of 
concern. Some purposes of the analysis can be to determine if 
a predetermined condition is exceeded, to make projection 
through simulation and data modeling areas of parameters 
that can lead to the failure of the worker entity or that might 
jeopardize the assigned mission, and ascertain the quality of 
performance of the system. The analysis can be performed by 
using regression techniques, neural network techniques, sta- 
tistical techniques, or any other technique that can convey 
information about the state of a system or emergent behavior 
of the system. Once the analysis has been performed, control 
can pass to action 1706 for further processing. 

In action 1706, an alarmed condition can be determined. In 
action 1706, the analysis of action 1704 can be referenced to 
determine if there is one or more alarm condition that can 
trigger the withdrawal of a stay alive signal. If no alarm 
conditions are determined, control can be passed to action 
1708 to generate a stay alive signal. In the event that an alarm 
condition is present, control can be passed to action 1710 for 
further processing. 

In action 1710, a determination can be performed to ascer- 
tain whether the identified alarmed condition of action 1706 
is recoverable by the managed entity, such as worker entities 
1118 and 1120 of FIG. 11. When an alarmed condition is 
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determined to be recoverable, control can be passed to action 
1708 to generate a stay alive signal. When an alarmed condi- 
tion is determined not to be recoverable, control can be passed 
to action 1712 to withdraw the stay alive signal. Method 1800 
5 below can be one embodiment of determining 1710 if the 
identified alarmed condition is recoverable. 

FIG. 18 is a flowchart of a method 1800 for ascertaining the 
recoverability of an alarmed condition determined at action 
1706 according to am embodiment. Method 1800 manages 
to autonomous entities that can be functionally extracted from 
an environment upon the occurrence of a predetermined con- 
dition. Method 1800 is one possible embodiment of the action 
in FIG. 17 above of determining 1710 if the identified alarmed 
condition is recoverable. 

15 Method 1800 can begin with action 1802 when receiving 
one or more alarmed conditions. In action 1802, a determi- 
nation is performed of whether or not an incorrect operation 
from the managed system has been identified in action 1704 
of FIG. 17. An incorrect operation can range from not initial- 
20 izing sensors to failing to self-heal when internal decision 
logic recommends as an appropriate cause of action. In action 
1802 in addition to determining if an incorrect operation has 
been identified, the number of devices or processes within the 
entity that registered an incorrect operation can be ascer- 
25 tained. If at least one incorrect operation is determined, the 
action can transfer the identity of the unit to evaluation block 
1808 for further processing. 

In action 1804, a determination is performed of whether or 
not emergent behavior from the managed system has been 
30 identified in action 1704 of FIG. 17. An emergent behavior or 
emergent property can appear when a number of entities 
(agents) operate in an environment forming behaviors that are 
more complex as a collective. The property itself can often be 
unpredictable and unprecedented and can represent a new 
35 level of the system’s evolution. This complex behavior in the 
context of control system can be known as non-linearity, 
chaos, or capacity limits. The complex behavior or properties 
can not be properties of any single such entity, nor can they 
easily be predicted or deduced from behavior in the lower- 
40 level entities. One reason why emergent behavior occurs can 
be that the number of interactions between autonomic com- 
ponents of a system increases combinatorially with the num- 
ber of autonomic components, thus potentially allowing for 
many new and subtle types of behavior to emerge. Nothing 
45 can directly command the system to form a pattern, but the 
interactions of each part (entities) to its immediate surround- 
ings can cause a complex process that leads to order. Emer- 
gent behavior can be identified based on parameters that give 
rise to the complex behavior in a system such as demands on 
50 resources. Once an emergent behavior condition has been 
identified, the information can be forwarded to evaluation 
block 1808 for further processing. 

In action 1806, a determination can be performed of alarm 
conditions that can have an impact on the success of the 
55 mission or task by which all entities are striving to accom- 
plish. The impact could be the ability to accomplish indi- 
vidual tasks or the potential for failure of the overall mission 
by permitting an entity to stay alive. This impact can be 
determined through Bayesian belief networks, statistical 
60 inference engines, or by any other presently developed or 
future developed inference engine that can ascertain the 
impact on a particular task if one or more agent is showing 
incorrect operation or harmful emergent behavior. Once the 
impact has been determined the information can be passed to 
65 evaluation block 1808 for further processing. 

Evaluation block 1808 can marshal the incorrect operation 
identified in action 1802, the emergent behavior in action 
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1804 , or the effect on mission in action 1806 to suggest a 
course of action that the managed entities should adopt, 
which in the present arrangement is based on a stay alive 
signal. The determination of withdrawing or affirming the 
stay alive signal can be based on the occurrence of one or 
more of the identified alarmed conditions, or a combination of 
two or more of the identified alarmed conditions. For 
example, the stay alive signal could be withdrawn if there is 
emergent behavior and there would be an effect on the mis- 
sion. In the alternative, the stay alive signal could be affirmed 
if there was only emergent behavior, or incorrect operation. 
Once the evaluation is determined, control can be passed to 
decision block 1810 for further processing in accordance to 
the decision made in evaluation block 1808 . 

In action 1810 , if the desired control instruction is to main- 
tain the stay alive signal, control can be passed to action 1708 
for further processing. In the alternative, a withdrawal of the 
stay alive signal can be sent to action 1712 for further pro- 
cessing. Generating a stay alive signal can be equivalent to 
generating a stay alive signal, affirming a stay alive signal, not 
withdrawing a stay alive signal, or any other condition that 
can determine if an entity is to perish or to extinguish unless 
allowed to continue by another entity. The other entity might 
be a managing entity since the other entity can determine the 
outcome (life or death) of an entity. 

FIG. 19 is a flowchart of a method 1900 to construct an 
environment to satisfy increasingly demanding external 
requirements according to an embodiment where a ruler 
entity decides to withdraw or generate a stay-awake signal. 
Method 1900 reduces the possibility that an autonomic ele- 
ment will jeopardize the mission of the autonomic element. 

Method 1900 can begin with action 1702 when receiving a 
signal from a managed entity. Action 1702 can receive a heart 
beat monitor (HBM) signal and pulse monitor (PBM) signal 
from a managed entity such as worker entities 1118 or 1120 . 
In some embodiments, the HBM signal is an indication that 
the managed entity (worker entity) is operating. The HBM 
can be an “ON/OFF” state signal, an indication that a process 
is being performed, or any other signal that can convey infor- 
mation that the worker entity is awake or active. The PBM 
signal can extend the HBM signal to incorporate reflex/ur- 
gency/health indicators from the autonomic manager repre- 
senting its view of the current self-management state. The 
PBM signal can thus convey the performance and character- 
istics of the entity in the form of engineering data summari- 
zation to add context to the received HBM signal. Engineer- 
ing data summarization could be a set of abstractions 
regarding sensors that, in some embodiments, could comprise 
rise and fall of data by a certain amount, external causes for 
parameter deviations, actual numerical value of the param- 
eters being summarized, warning conditions, alarm condi- 
tions, and any other summarization that would convey the 
general health of the system. Once the HBM and PBM signals 
have been received, control can be forwarded to action 1704 
for further processing. 

In action 1904 , an analysis of the HBM and PBM signal 
can be performed to determine trends and possible areas of 
concern. The purpose of the analysis can be to determine that 
a predetermined condition has been exceeded, generate a 
projection through simulation and data modeling areas of 
parameters that can lead to the failure of the worker entity or 
that might jeopardize the assigned mission, and ascertain the 
quality of performance of the system. The analysis can be 
performed by using regression techniques, neural network 
techniques, statistical techniques, or any other technique that 
can convey information about the state of a system or emer- 
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gent behavior of the system. Once the analysis has been 
performed, control can be passed to action 1706 for further 
processing. 

In action 1706, an alarmed condition can be determined. In 
5 action 1706 , the analysis of action 1704 can be referenced to 
determine if there is one or more alarm condition that can 
trigger the withdrawal of a stay -awake signal. If no alarm 
conditions are determined, control can be passed to action 
1902 to generate a stay -alive signal. In the event that an alarm 
to condition is present, control can be passed to action 1904 for 
further processing. 

In action 1904 , a determination can be performed to ascer- 
tain if the identified alarmed condition of action 1706 is 
recoverable by the managed entity such as worker entities 
15 1118 and 1120 of FIG. 11 . When an alarmed condition is 
determined not to be recoverable, control can be passed to 
action 1712 to withdraw the stay-alive signal. Method 2000 
below could be one embodiment of determining 1904 if the 
identified alarmed condition is recoverable. When an alarmed 
20 condition is determined to be recoverable, control can be 
passed to action 1908 in which a determination can be per- 
formed to ascertain if quiescing the managed entity and/or 
subsequent recovery is possible. When quiescence of the 
managed entity and/or need for later recovery is determined 
25 as not possible, control can pass to action 1902 to generate a 
stay-awake/stay -alive- signal. When quiesence of the man- 
aged entity is determined as possible and/or needed in action 
1908 , control can pass to action 1910 , to withdraw the stay- 
awake signal. Thus, quiescing the managed entity function- 
30 ally extracts the managed entity from an environment upon 
the occurrence of an alarmed condition. Quiescence can be a 
less encompassing alternative to withdrawing the stay-awake 
signal of apoptosis. Method 1900 can allow an agent or craft 
that is in danger or endangering the mission to be put into a 
35 self-sleep mode, then later reactivated or self-destructed. 

FIG. 20 is a flowchart of a method 2000 for ascertaining the 
recoverability of an alarmed condition determined at action 
1904 . Method 2000 manages autonomous entities that can be 
functionally extracted from an environment upon the occur- 
40 rence of a predetermined condition. 

Method 2000 can begin with action 1802 when receiving 
one or more alarmed conditions. In action 1802 , a determi- 
nation is performed as to whether or not an incorrect opera- 
tion from the managed system has been identified in action 
45 1 704 of FIG. 17 . An incorrect operation can range from not 
initializing sensors to failing to self-heal when internal deci- 
sion logic recommends as an appropriate cause of action. In 
action 1802 , in addition to determining if an incorrect opera- 
tion has been identified, the number of devices or processes 
50 within the entity that registered an incorrect operation can be 
ascertained. If at least one incorrect operation is determined, 
the action can transfer the identity of the unit to evaluation 
block 1808 for further processing. 

In action 1804 , there can be a determination of emergent 
55 behavior from the managed system that has been identified in 
action 1704 of FIG. 17 . An emergent behavior or emergent 
property can appear when a number of entities (agents) oper- 
ate in an environment forming behaviors that are more com- 
plex as a collective. The property itself can often be unpre- 
60 dictable and unprecedented and can represent a new level of 
the system’s evolution. This complex behavior in the context 
of control system can be known as non-linearity, chaos, or 
capacity limits. The complex behavior or properties can not 
be properties of any single such entity, nor can they easily be 
65 predicted or deduced from behavior in the lower-level enti- 
ties. One reason why emergent behavior occurs could be that 
the number of interactions between autonomic components 
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of a system increases combinatorially with the number of 
autonomic components, thus potentially allowing for many 
new and subtle types of behavior to emerge. Nothing can 
directly command the system to form a pattern, but instead the 
interactions of each part (entities) to its immediate surround- 
ings can cause a complex process that leads to order. Emer- 
gent behavior can be identified based on parameters that give 
rise to the complex behavior in a system such as demands on 
resources. Once an emergent behavior condition has been 
identified, the information can be forwarded to evaluation 
block 1808 for further processing. 

In action 1806, a determination can be performed of alarm 
conditions that can have an impact on the success of the 
mission or task which all entities are striving to accomplish. 
The impact could be the ability to accomplish individual tasks 
or the potential for failure of the overall mission by permitting 
an entity to stay awake. This impact can be determined 
through Bayesian belief networks, statistical inference 
engines, or by any other presently developed or future devel- 
oped inference engine that can ascertain the impact on a 
particular task if one or more agent is showing incorrect 
operation or harmful emergent behavior. Once the impact has 
been determined, the information can be passed to evaluation 
block 1808 for further processing. 

Evaluation block 1808 can marshal the incorrect operation 
identified in action 1802, the emergent behavior in action 
1804, and the effect on mission in action 1806 to suggest a 
course of action that the managed entities should adopt, 
which in the present arrangement is based on a stay-awake 
signal. The determination of withdrawing or affirming the 
stay-awake signal can be based on the occurrence of one or 
more of the identified alarmed conditions, or a combination of 
two or more of the identified alarmed conditions. For 
example, the stay -awake signal could be withdrawn if there is 
emergent behavior and there would be an effect on the mis- 
sion. In the alternative, the stay-awake signal could be 
affirmed if there was only emergent behavior, or incorrect 
operation. Once the evaluation is determined, control can 
pass to decision block 2002 for further processing in accor- 
dance with the decision made in evaluation block 1808. 

In action 2002, if the desired control instruction is to main- 
tain the stay-awake signal, control can be passed to action 
1902 for further processing. In the alternative, a withdrawal of 
the stay-awake signal can be sent to action 1910 for further 
processing. Generating a stay -awake signal is equivalent to 
affirming a stay awake signal, not withdrawing a stay awake 
signal, or any other condition that can determine if an entity is 
to perish or to extinguish unless allowed to continue by 
another entity. The other entity could be a managing entity 
since the other entity can determine the outcome (life or 
death) of an entity. 

FIG. 21 is a flowchart of a method 21 00 for ascertaining the 
recoverability of an alarmed condition determined at action 
1904. Method 2100 manages autonomous entities that can be 
functionally extracted from an environment upon the occur- 
rence of a predetermined condition. 

Method 2100 can begin with action 2102 after having 
received one or more alarmed conditions. In action 2102, a 
determination is performed as to whether or not an invalid 
communication from the managed system has been identified 
in action 1704 of FIG. 17. In action 2102, in addition to 
determining if an invalid communication has been identified, 
the number of devices or processes within the entity that 
registered an invalid communication can be ascertained. If at 
least one invalid communication is determined, the identity of 
the unit can be transferred to evaluation block 1 8 0 8 for fiirther 
processing. An invalid communication is a communication 


22 

handshake that doesn’t match an expected protocol, such as 
the “rogue” agent didn’t respond in the expected manner, or in 
the expected time limits, or failed to send a signal in the 
correct format. 

5 In action 21 04 , a determination is performed as to whether 

or not a rogue agent from the managed system that has been 
identified in action 1704 of FIG. 17. A rogue agent can exist 
when a number of entities (agents) operate in an environment 
forming behaviors that are more complex as a collective. One 
to cause of a rogue agent could be that the number of interac- 
tions between autonomic components of a system increases 
combinatorially with the number of autonomic components, 
thus potentially allowing for many new and subtle types of 
counterproductive behavior to emerge. Nothing can directly 
15 command the system to form a pattern, but instead the inter- 
actions of each part (entities) to its immediate surroundings 
can cause a complex process that leads to order. A rogue agent 
can be identified based on parameters that give rise to the 
complex behavior in a system such as demands on resources. 
20 Once a rogue agent has been identified, the information can 
be forwarded to evaluation block 1808 for further processing. 

In action 21 06, a determination can be performed of safety/ 
security issue/concems that can have an impact on the success 
of the mission or task which all entities are configured to 
25 accomplish. The impact could be the ability to accomplish 
individual tasks or the potential for failure of the overall 
mission by permitting an entity to stay awake. This impact 
can be determined through Bayesian belief networks, statis- 
tical inference engines, or by any other presently developed or 
30 fiiture developed inference engine that can ascertain the 
impact on a particular task if one or more agent is showing 
invalid communication or harmful rogue agent. Once the 
safety/security issue/concem has been determined, the infor- 
mation can be passed to evaluation block 1808 for further 
35 processing. 

Evaluation block 1808 can marshal the invalid communi- 
cation identified in action 2102, the rogue agent in action 
2104, and the safety/security issue/concem in action 2106 to 
suggest a course of action that the managed entities should 
40 adopt, which in the present arrangement is based on a stay- 
awake signal. The determination of withdrawing or affirming 
the stay-awake signal can be based on the occurrence of one 
or more of the identified alarmed conditions, or a combination 
of two or more of the identified alarmed conditions. For 
45 example, the stay -awake signal could be withdrawn if there i s 
rogue agent and there would be a safety/security issue/con- 
cern of the mission. In the alternative, the stay-awake signal 
could be affirmed if there was only rogue agent, or invalid 
communication. Once the evaluation is determined, control 
50 can pass to decision block 2002 for further processing in 
accordance with the decision made in evaluation block 1808. 

In action 2108, if the desired control instruction is not to 
transmit a neutralizing data signal, control can be passed to 
action 1902 for further processing. In the alternative, a neu- 
55 tralizing data signal can be sent in action 1910 for further 
processing. The self managing autonomous system can self- 
protect from spurious signals or signals generated by a rogue 
agent that has failed to engage in a satisfactory Alice 
exchange by generating a neutralizing data signal. A neutral - 
60 izing data signal is a counteracting signal to the spurious 
signals or signals generated by a rogue agent that is intended 
to stop the self managing autonomous system from receiving, 
or at least from reacting to, these unwanted signals, effec- 
tively having an overriding effect or an equalizing effect on 
65 any reflex signal received by the self managing autonomous 
system, in essence, countersignals can be generated that will 
render the undesirable signals harmless to the self managing 
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autonomous system. The security and protection of the self 
managing autonomous system may be improved by the use of 
the neutralizing data signal. The neutralizing data signal can 
help ensure that self-managing complex systems operate cor- 
rectly without human intervention where management by 
humans is simply not realistic or even feasible. 

Generating a neutralizing data signal can be equivalent to 
affirming a neutralizing data signal, not withdrawing a neu- 
tralizing data signal, or any other condition that can determine 
if an entity is to counteract a spurious signal or signal from a 
rogue agent. The other entity could be a managing entity since 
the other entity can determine the outcome (life or death) of 
an entity. 

The present invention may draw inspiration from or have 
some similarities to the mammalian acoustic or stapedius 
reflex, although one skilled in the art will recognize that when 
in danger of exposure to extreme sounds that may damage the 
ear drum, the mammalian body protects itself. The acoustic 
reflex, or stapedius reflex, is an involuntary muscle contrac- 
tion in the middle ear of mammals in response to high-inten- 
sity sound stimuli. The mammalian otoacoustic mechanism, 
called otoacoustic emission, involves the generation of sound 
from within the inner ear in response to over-activity of the 
cochlear amplifier. That is, when the body is presented with a 
sound that is potentially damaging, the inner ear generates a 
counter-sound, which is benign, and protects the inner ear 
from hearing it. 

In some embodiments, all of the agents, components and 
apparatus of FIGS. 1-6 or 11-16 can detect and/or issue the 
neutralizing data signal, as long as the agents, components 
and apparatus are “friendly” (i.e., known not to be rogue) 
agents. In some embodiments, however, only a coordinating 
agent, such as ruler NBF 608, can perform method 2100. 

FIG. 22 is a flowchart of a method 2200 for providing 
security requirements according to an embodiment where a 
ruler entity decides to withdraw or generate a stay alive signal 
from an anonymous agent. Method 2200 manages autono- 
mous entities that can be functionally extracted from an envi- 
ronment upon the occurrence of a predetermined condition. 
Method 2200 can begin with action 2202 where an ALice 
signal is sent to an anonymous agent to ascertain the potential 
for harm of the agent to a system as shown in FIG. 22. After 
the ALice signal has been sent to the agent, control can be 
passed to action 2204 for further processing. 

In action 2204 the response from the agent can be moni- 
tored. Monitored as used herein refers to maintaining regular 
surveillance, or close observation, over an anonymous agent 
and can include the absence of a signal. For example, not 
responding with a timeout period is considered, as used 
herein, as monitor response. After action 2204 is completed, 
control can be passed to action 2206 for further processing. 

In action 2206, the monitored response from action 2204 
can be analyzed to determine if the monitored response is in 
an appropriate format, within a certain timeout period, and 
with a valid and justified reason for being within the locust of 
interest or domain of the autonomous system 2204 as shown 
in FIG. 22. Once the potential for causing harm has been 
ascertained, control can be passed to action 2208 for further 
processing. 

In action 2208, the system can control the future of the 
anonymous agent based on the potential for harm to the 
autonomous system. This mimics the mechanism of cell 
death in the human (and animal) body, and hence makes use 
of autonomic and other biologically inspired metaphors. The 
technique would send self-destruct signals to agents that can 
be compromised, or which cannot be identified as friendly or 
as having a right to access certain resources. The concept of 
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the ALice signal is to challenge a mobile agent to determine if 
the mobile agent is friendly and to determine if the mobile 
agent has permission to access certain resources. If the mobile 
agent fails to identify itself appropriately following an ALice 
5 interrogation, the mobile agent can be blocked from the sys- 
tem and given either a self-destruct signal, or its stay alive 
reprieve is withdrawn. As an alternative to the ALice signal, a 
quiesce signal, command or instruction can be sent. The 
quiesce signal is discussed in more detail in conjunction with 
to FIGS. 10, 19 and 20. 

FIG. 23 is a flowchart of a method 2300 of autonomic 
communication by an autonomic element. Method 2300 can 
offer a holistic vision for the development and evolution of 
computer-based systems that brings new levels of automation 
15 and dependability to systems, while simultaneously hiding 
their complexity and reducing their total cost of ownership. 

Method 2300 can include transmitting self health/urgency 
data 2302. Examples of the self health/urgency data can 
include information describing low battery power and/or 
20 failed sensors. Method 2200 can also include transmitting 
2304 environment health/urgency data. Examples of the envi- 
ronment health/urgency data can include information 
describing inaccessible devices, unauthorized access, and/or 
an unidentified mobile agent sending communication signals. 
25 Transmitting 2302 and 2304 can be performed in any order 
relative to each other. For example, in one embodiment the 
transmitting 2302 self health/urgency data can be performed 
before transmitting 2304 environment health/urgency data. In 
another embodiment, transmitting 2304 environment health/ 
30 urgency data can be performed before transmitting 2302 self 
health/urgency data. In yet another embodiment, the self 
health/urgency data can be transmitted simultaneously with 
the environment health/urgency data. For example, the envi- 
ronment health/urgency data and the self health/urgency data 
35 can be transmitted together. One example of transmitting the 
environment health/urgency data and the self health/urgency 
data can include encapsulating the environment health/ur- 
gency data and the self health/urgency data in a X.25 packet, 
although one skilled in the art will readily recognize that any 
40 number of alternative packet types can be used that fall within 
the scope of this invention. The environment health/urgency 
data and the self health/urgency data can be thought of 
together as the “lub-dub” of a heartbeat in which the two 
“beats” or two pieces of data are transmitted simultaneously. 
45 The X.25 standard is published by the ITU Telecommunica- 
tion Standardization Sector at Place des Nations, CH-1211 
Geneva 20, Switzerland. 

An autonomic environment can require that autonomic 
elements and, in particular, autonomic managers communi- 
50 cate with one another concerning self-* activities, in order to 
ensure the robustness of the environment. A reflex signal 
1620 of FIG. 16 above can be facilitated through the pulse 
monitor (PBM). A PBM can be an extension of the embedded 
system’s heart-beat monitor, or HBM, which safeguards vital 
55 processes through the emission of a regular “I am alive” 
signal to another process with the capability to encode self 
health/urgency data and environment health/urgency data as a 
single pulse. HBM is described in greater detail in FIGS. 14 
and 21 above. Together with the standard event messages on 
60 an autonomic communications channel, this can provide 
dynamics within autonomic responses and multiple loops of 
control, such as reflex reactions among the autonomic man- 
agers. Some embodiments of the autonomic manager com- 
munications (AM/AM) component 1618 can produce a reflex 
65 signal 1620 that includes the self health/urgency data and the 
environment health/urgency data in addition to the HBM. 
More concisely, the reflex signal can carry a PBM. A reflex 
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signal that carries a PBM can be used to safe-guard the auto- 
nomic element by communicating health of the autonomic 
element to another autonomic unit. For instance, in the situ- 
ation where each PC in a LAN is equipped with an autonomic 
manager, rather than each of the individual PCs monitoring 
the same environment, a few PCs (likely the least busy 
machines) can take on this role and alert the others through a 
change in pulse to indicate changing circumstances. 

An important aspect concerning the reflex reaction and the 
pulse monitor is the minimization of data sent — essentially 
only a “signal” is transmitted. Strictly speaking, this is not 
mandatory; more information can be sent, yet the additional 
information should not compromise the reflex reaction. 

Just as the beat of the heart has a double beat (lub-dub), the 
autonomic element’s pulse monitor can have a double beat 
encoded — as described above, a self health/urgency measure 
and an environment health/urgency measure. These match 
directly with the two control loops within the AE, and the 
self-awareness and environment awareness properties. 

FIG. 24 is a flowchart of a method 2400 of autonomic 
communication by an autonomic element. Method 2400 can 
include transmitting 2402 event message data in addition to 
the self and environment health/urgency data. Event message 
data can include data describing a change in condition, or a 
deviation from a normal operation. Event message data is 
described in more detail above in FIG. 11. 

In some embodiments, the self health/urgency data and 
environment health/urgency data encoded with the standard 
event messages on an autonomic communications channel, 
can provide dynamics within autonomic responses and mul- 
tiple loops of control, such as reflex reactions among an 
autonomic manager. 

FIG. 25 is a flowchart of a method 2500 of autonomic 
communication by an autonomic element. Method 2500 can 
include receiving 2502 the self health/urgency data from a 
self control loop component of the autonomic element. One 
example of the self control loop component of the autonomic 
element can be the self awareness control loop 1614 of the 
autonomic element 1600 of FIG. 16 above. 

Method 2500 can also include receiving 2504 the environ- 
ment health/urgency data from an environment control loop 
component of the autonomic element. One example of the 
environment control loop component of the autonomic ele- 
ment can be the environment awareness control loop 1608 of 
the autonomic element 1600 of FIG. 16 above. 

FIG. 26 is a flowchart of a method 2600 of autonomic 
communication by an autonomic element. Method 2600 can 
offer a holistic vision for the development and evolution of 
computer-based systems that brings new levels of automation 
and dependability to systems, while simultaneously hiding 
their complexity and reducing processing delays by systems 
that receive data from the autonomic element. 

Method 2600 can include transmitting uncompressed self 
health/uigency data 2602. Method 2600 can also include 
transmitting 2604 uncompressed environment health/ur- 
gency data. In the absence of bandwidth concerns, the uncom- 
pressed data can be acted upon quickly and not incur process- 
ing delays . One important aspect can be that the data, whether 
uncompressed or sent in some other form, should be in a form 
that can be acted upon immediately and not involve process- 
ing delays (such as is the case of event correlation). Trans- 
mitting 2602 and 2604 can be performed in any order relative 
to each other. 

Conclusion 

An otoacoustic component of an autonomic unit can render 
an incoming potentially harmful signal inert. Self-managing 
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systems, whether viewed from the autonomic computing per- 
spective, or from the perspective of another initiative, can 
offer a self-defense capability that brings new levels of auto- 
mation and dependability to systems, while simultaneously 
5 hiding their complexity and reducing their total cost of own- 
ership. 

Although specific embodiments have been illustrated and 
described herein, it will be appreciated by those of ordinary 
skill in the art that any arrangement which is calculated to 
to achieve the same purpose can be substituted for the specific 
embodiments shown. This application is intended to cover 
any adaptations or variations. For example, although 
described in procedural terms, one of ordinary skill in the art 
will appreciate that implementations can be performed in an 
1 5 obj ect-oriented design environment or any other design envi - 
ronment that provides the required relationships. 

In particular, one of skill in the art will readily appreciate 
that the names of the methods and apparatus are not intended 
to limit embodiments. Furthermore, additional methods and 
20 apparatus can be added to the components, functions can be 
rearranged among the components, and new components to 
correspond to future enhancements and physical devices used 
in embodiments can be introduced without departing from the 
scope of embodiments. One of skill in the art will readily 
25 recognize that embodiments are applicable to future commu- 
nication devices, different file systems, and new data types. 

The terminology used in this application is meant to 
include all environments and alternate technologies which 
provide the same functionality as described herein. 

30 We claim: 

1. A method for protecting an autonomic system when 
encountering one or more autonomic agents, the method 
comprising: 

determining the potential harm of the autonomic agent; 

35 sending a neutralizing data signal to the autonomic agent; 
monitoring a response of the autonomic agent to the neu- 
tralizing data signal; and 

controlling the autonomic system based on a potential for 
the autonomic agent to cause harm to the autonomic 
40 system, wherein controlling the autonomic system com- 
prises generating a signal to the autonomic agent to 
withdraw the autonomic agent stay-alive/stay-awake. 

2. A computer-accessible medium having executable 
instructions to protect an autonomic system when encounter- 

45 ing one or more autonomic agent, the executable instructions 
capable of directing a processor to perform: 

sending a neutralizing data signal to the autonomic agent; 
monitoring a response of the autonomic agent to the neu- 
tralizing data signal, wherein the neutralizing data signal 
50 equalizes the potential harm of the autonomic agent; and 

determining a potential for the autonomic agent to cause 
harm to the autonomic system; and 
controlling the autonomic system based on the potential of 
the autonomic agent to cause harm to the autonomic 
55 system, wherein controlling the autonomic system com- 
prises generating a signal to the autonomic system to 
counteract a signal of the autonomic agent. 

3. A computer system for protecting an autonomic system 
when encountering one or more autonomic agent, the com- 

60 puter system comprising: 
a processor; 

a storage device coupled to the processor; and 
software means operative on the processor for: 

(i) sending a neutralizing data signal to the autonomic 

65 agent; 

(ii) monitoring a response of the autonomic agent to the 
neutralizing data signal, wherein the neutralizing data 
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signal has an overriding effect on a potentially harm- 
ful signal received by the autonomic system; and 
(iii) determining a potential of the autonomic agent to 
cause harm to the autonomic system, 
wherein the neutralizing data signal has an equalizing 5 
effect on a reflex signal received by the autonomic sys- 
tem. 

4. A computer system for protecting an autonomic system 
when encountering one or more autonomic agent, the com- 
puter system comprising: 1C 

a processor; 

a storage device coupled to the processor; and 
software means operative on the processor for: 
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(i) sending a neutralizing data signal to the autonomic 
agent; 

(ii) monitoring a response of the autonomic agent to the 
neutralizing data signal, wherein the neutralizing data 
signal has an overriding effect on a potentially harm- 
ful signal received by the autonomic system; and 

(iii) determining a potential of the autonomic agent to 
cause harm to the autonomic system, 

wherein the neutralizing data signal renders the potentially 

harmful signal harmless. 



